Constructing a Personality-Annotated Corpus for Educational Game based on Leary's Rose Framework

Researchers have recognized the importance of classifying personality through discourse for many years. However, this line of research tends to focus almost exclusively on the personality categories known as the Big Five factors. Though this information is certainly valuable, it may also be useful to categorize personality based on the Leary’s Interpersonal Circumplex model which emphasizes a predictive function. In this paper we construct the data set for personality annotation among six dimensions (based on a coding scheme developed from Leary’s Interpersonal Circumplex) for players using a chat interaction in an epistemic game, Land Science. Our results indicate that overall personality annotation is reliable (Average Kappa = 0.65) with the highest reliability for the competitive dimension and the lowest reliability for the leading dimension. Introduction There has been a great interest in classifying personality types in numerous fields spanning decades of research. In particular, the notion that personality characteristics are an important consideration in the field of education, has been re-emphasized in current literature. For example, personality characteristics have been shown to be related to both academic motivation and performance (Komarraju & Karau, 2005; Poropat, 2009). A considerable amount of research such as those previously mentioned is rooted in the Big Five personality factors (Norman, 1963). There is some debate, however, whether or not the Big Five factors adequately capture all dimensions of personality. For example, some research indicates that behavior may be better predicted based on specific personality traits, some of which are not accounted for in the Big Five factors (Ashton, 2001). A framework for personality classification that emphasizes the predictive value of personality traits is Leary’s Interpersonal Circumplex (Leary, 1957). This paper is organized in four sections. First, the paper includes a brief description of Leary’s Rose framework and the Land Science Epistemic game. Section two explains the related work. Our model is described in section three. The results are described in the fourth section. Finally, we end the paper with Conclusion and Future work. Leary’s Interpersonal Circumplex Leary’s Interpersonal Circumplex (or Leary’s Rose) has been used by researchers for decades as a foundation for categorizing personality through the discourse (Leary, 1957) (See Figure 1). The Circumplex defines characteristics according to two dimensions: the above-below axis represents variation from dominant (above) to submissive (below) whereas the opposed-together axis represents variations of cooperation from accommodating (together) to (opposed). The Rose can easily be separated into four quadrants and then further split into eight different categories (see Table 1 for examples). Educational Game Based on Leary’s Rose Framework Copyright © 2012, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved. 147 Proceedings of the Twenty-Fifth International Florida Artificial Intelligence Research Society Conference